Recurrent Neural Networks

Back to Home

01. Introducing Ortal
02. RNN Introduction
03. RNN History
04. RNN Applications
05. Feedforward Neural Network-Reminder
06. The Feedforward Process
07. Feedforward Quiz
08. Backpropagation- Theory
09. Backpropagation - Example (part a)
10. Backpropagation- Example (part b)
11. Backpropagation Quiz
12. RNN (part a)
13. RNN (part b)
14. RNN- Unfolded Model
15. Unfolded Model Quiz
16. RNN- Example
17. Backpropagation Through Time (part a)
18. Backpropagation Through Time (part b)
19. Backpropagation Through Time (part c)
20. BPTT Quiz 1
21. BPTT Quiz 2
22. BPTT Quiz 3
23. Some more math
24. RNN Summary
25. From RNN to LSTM
26. Wrap Up

Back to Home

21. BPTT Quiz 2

_A folded RNN model_ — A folded RNN model

Lets look at the same folded model again (displayed above). Assume that the error is noted by the symbol E. What is the update rule of weight matrix V1 at time t, over a single timestep ?

Equation A

Equation B

Equation C

Equation D

SOLUTION:

Equation B

Solution

Equation B Is the only equation with the correct derivation of the chain rule with the proper use of the learning rate.

udacimak v1.3.0